Adaptive Visual Servoing of Robot Manipulators without Measuring the Image Velocity

The direct adaptive control of planar robot manipulators through visual servoing is considered. A solution is developed for image-based visual systems to allow tracking of a desired trajectory, when both camera calibration and robot dynamics are uncertain. In order to solve the MIMO parameter adaptive problem without using image velocity information, the adaptive camera calibration is formulated as a relative degree two MIMO adaptive control problem. A recently proposed Lyapunov/passivity-based adaptive control for relative degree two MIMO system based on SDU factorization is applied. The resulting adaptive calibration is then combined with an adaptive motion controller for the manipulator, which takes into account its uncertain nonlinear dynamics. The overall stability of the adaptive visual servoing system can be proved thanks to the explicit Lyapunov-like functions of both adaptation schemes.